HIGH-STAKES EXAMINATIONS

The Development and Application of an Expert Marker System to Support ‘high Stakes’ Examinations

The OCR CLAIT scheme was first established in the early 1980’s and has been used as the benchmark assessment for vocational IT skills ever since. It currently attracts over 300,000 entries per year across 9 different application areas. This equates to over 1m scripts per year, all of which require marking, moderation and processing to award of result. Over the last 5 years OCR has worked with t...

Accuracy of portrayal by standardized patients: Results from four OSCE stations conducted for high stakes examinations

BACKGROUND The reliability in Objective Structured Clinical Exams (OSCEs) is based on variance introduced due to examiners, stations, items, standardized patients (SP), and the interaction of one or more of these items with the candidates. The impact of SPs on the reliability has not been well studied. Accordingly, the main purpose of the present study was to assess the accuracy of portrayal by...

Preparing the Implementation of Computerized Adaptive Testing for High-Stakes Examinations

Personnel Licensing Examination (NHPLE) of the Republic of Korea visited Hallym University to observe students taking a computerized adaptive testing (CAT) via personal computer. Afterwards, the staff members discussed CAT and its installation with Hallym University faculty and the psychometrician. NHPLE is still undecided about the timetable for introducing CAT to the Korean Medical Licensing ...

High-Stakes Interpretation

High-Stakes Testing

I review the literature on the impact on student achievement of high-stakes testing. Its popularity as a mechanism for holding educators accountable has triggered studies to examine whether its promise to increase student learning has been fulfilled. The review concludes there is no consistent evidence to suggest high-stakes testing leads to increases in student learning. Some evidence suggests...